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NAVIGATIONAL CAPABILITIES OF THE SEXTANT AND RANGING 
DEVICE FOR CSM-ACTIVE RENDEZVOUS 

By Jack. H* Shreffler 


SUMMARY 


This internal note presents navigation error analysis results which 
are used to evaluate the navigational capabilities of the sextant, 
the ranging device, and the two in combination in the interval between 
CDH and TPI. Specifically, these studies were initiated in response 
to paragraph 4 of reference 1, which asserts that theisextant ^s ability 
to refine relative state uncertainties increases with increasing Ah 
during the coelliptic phase of a rendezvous sequence. This assertion 
is basically untrue. 

The following conclusions were made from the results of this study. 

(a) The sextant’s ability to refine relative state uncertainties 
increases slightly with decreasing Ah. during the coelliptic phase. 

(b) Disregarding a priori knowledge, the sextant may' be used as 
a navigational instrument to determine relative state uncertainties 
to within 60 n. mi. and 435 fps (3a) after 15 minutes of tracking. 

(c) The sextant’s navigational capability is primarily based 
on establishing correlations between the in-plane orbital elements 
which tends to reduce uncertainties upon propagation. Also, the sex- 
tant reduces out-of-plane uncertainties extremely well. 

(d) Disregarding a priori knowledge, the ranging device and the 
ranging device with the sextant both have the ability to determine the 
relative state to within 0.75 n. mi. and 7. 5 fps (3a) after 15 minutes 
of tracking. 

This study considers only circular, coelliptic, earth orbits; 
the target vehicle is in a 150-n. mi. orbit, and Ah. between the 
vehicles does not exceed 4o n. mi. 
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INTRODUCTION 

The vork summarized in this note was initiated to determine the 
sextant’s navigational capability as a function of Ah during the coelliptic 
phase of a CSM-active rendezvous. It was determined that the sextant’s 
ability to refine the relative state estimate increases slightly with 
decreasing Ah. This conclusion was diametrically opposed to the currently 
accepted view, however, so that further examinations of the sextant’s 
capabilities were in order. The additional studies were performed 
holding the Ah constant at 15 n. mi. 

By allowing the inter vehicular data to freely correct the relative 
state estimate, it was determined that the sextant has very little absolute 
navigational capability. That is, it cannot determine the relative 
state in the same sense as do the ground radars or rendezvous radar. 

It is well known, however, that the sextant may be used to produce a 
reduction of relative state uncertainties. Therefore, a series of runs 
were made to determine how the sextant may be successfully used. Basi- 
cally, it was found that the previous knowledge of -the state must be 
heavily relied upon. The sextant merely establishes correlations be- 
tween the in-plane orbital elements which results in a decrease of: 
uncertainties upon propagation. 

With this knowledge, another look was given to the sextant’s 
capability as a function of differential altitude and hopefully, a 
plausible, albeit qualitative, explanation is given for the new results. 


ASSUMPTIONS 

The uncertainties associated with both vehicles ’i states were 
represented by a covariance matrix generated at CDH + 15 minutes for 
Apollo 6 (AS-205/lOl) analyses. Additional uncertainties were introduced 
from the following sources: 

(1) Noise on intervehicular measurements 

0,0002 radians for each sextant angle 
10 ft in range 

(2) Noise on intervehicular measurements 

0.0002 radians for each sextant angle 

10 ft In rasme ' 

(3) Uncertainty in y of the _ earth; 

a = 1.05 X lO^l ft^/sec^- 
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(4) Misalignment of IMU axes: 

0 = 5*^ ^ 10~^ radians per axis 

(5) Uncertainty in drag acceleration on Uoth vehicles; 
a = 10"^ ft/sec^ 

The target vehicle -was assumed to be in a 150-n. mi. circular 
orbit. First, cases are considered where the Ah between the chaser 
vehicle and the target was varied. Then, Ah was held constant at 15 n. mi. 
for all cases considered and, unless otherwise stated, the chaser vehicle 
was trailing and below. In all cases, 15 intervehicular measurements 
spaced 1 minute apart are taken. The first mark is assumed to be taken 
at CDH + 15 minutes . TPI is assumed to be 20 minutes after the last 
mark. 


SEXTANT NAVIGATIONAL CAPABILITY AS A FUNCTION OF Ah 

The chaser vehicle was assumed to be in a circular orbit below 
and behind the target at altitudes of 110, 120, 130, 135 » l40, l45, and 
148 n. mi. The trailing distance was adjusted so that the angle between 
the line-of-sight vector and the tangent to the chaser vehicle orbit at 
the chaser vehicle was equal to 9*2065° at the beginning of tracking for 
all Ah. The IMU was oriented so that this was also the azimuth angle. 
The azimuth angle was then computed 10, 15, and 20 minutes later for 
the various Ah’s, as given in the table below. 


Ah, n. mi. 

Azimuth angles at times after start of tracking, deg 

10 min 

.15 min 

1 20 min 

40 

-28.4253 

-46.6925 

-64.3696 

30 

-28.5451 

-46.9385 

-64.8229 

20 

-28.6673 

-.47.1848 

-65.2689 

15 

-28.7298 

-47.3092 

-65.4911 

10 

-28.7930 

-47.4335 

-65.7106 

5 

-28.858!* 

-47.5614 

-65.9349 

2 

-28.8996 

- 

-47.6412 

-66.0738 
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.’Pwo observations may be made concerning these aximuth angles. First, 
over a 15-minute period the azimuth angles of vehicles along the line of 
sight will have changed significantly enough to make it possible to 
determine Ah to about 5 n. mi. Second, the residuals of the azimuth 
angles at a given time compared to a nominal (e.g., the azimuth angle 
for Ah = 15 n, mi.) constitute a linear function of Ah. Figure 1 gives 
a plot of azimuth angle residuals as a function of Ah for a time 15 min- 
utes after azimuth angles were equal for all Ah. 

The linearity of the residuals gives the theoretical answer to 
the question "Does increasing Ah increase the sextant’s navigational 
capability during the coelliptic phase?" The answer is no. 

To say that the chaser vehicle has a certain line-of-sight un- 
certainty means essentially that if a vehicle deviates farther along 
the line of sight, a residual detectable above noise and bias levels 
would develop. However, by linearity, the detectable residual will be 
caused by the same displacement for all Ah, Thus, the same uncertainties 
may be expected. 

The error analysis was performed with a linear error analysis 
program which treats the simulated sextant measurements in a .manner equi- 
valent to the onboard computer. The fit-world covariance was assumed 
to be reinitialized with a 1000 ft - 1 fps W-matrix before the first 
mark. Such a small W-matrix means that the estimate of the relative 
state will be corrected only slightly by the sextant measurements. In- 
stead the a priori knowledge is heavily relied upon. The reason that 
this is the best procedure is discussed later. 

The uncertainties at beginning of tracking and at TPI (assumed 
to be 20 minutes after the end of tracking) are presented in table I. 

We see that for greater Ah’s the uncertainties increase, which may be 
explained by the noise and biases on the measurements. At a distance 
r, noise of angle 0 will produce a linear displacement, r0*. Thus, 
for larger Ah an error in the angle measurement will produce a propor- 
tionately larger error in the relative state vector. 

ABSOLUTE NAVIGATION CAPABILITY OF THE SEXTANT, 

RANGING DEVICE, AND BOTH IN COMBINATION 


As mentioned previously, using a W-matrix of 1000 ft - 1 fps 
limits the amount the intervehicular measurements would be allowed 
to correct the a priori state estimate. In order to determine what 
navigation capability could be derived almost solely from these 
measurements, some 15-n. mi. Ah cases were run where the fit-world 
covariance was reinitialized with a 1 000 000 ft - 1000 fps W-matrlx 



prior to the first mark. Fifteen marks vere taken using the sextant, the 
ranging device, and the two in combination. 

The relative state uncertainties are tabulated in table II. It 
is apparent that the sextant has little navigation capability over 
short arcs, being able to determine relative state at TPI to within 
60 n. mi. and k35 fps (3cr). Almost all the position uncertainty is 
along the line of sight. It should be noted, however, that the sextant 
reduces the out-of-plane uncertainties to about 85O ft and 8 fps (3a). 

The addition of the range measurements reduces radically the 
line-of-sight uncertainty and gives the combination a very definite 
navigation capability giving 3a uncertainties at TPI of 0.75 n. mi. and 
7.5 fps. 


USE OF THE SEXTANT WITH RANGING DEVICE AS OPPOSED TO 
THE RANGING DEVICE ALONE 


It has been 'indicated in this study as well as some for lunar 
orbit that, provided out-of-plane uncertainties have been reduced by 
previous sextant tracking, it is better to use the ranging device alone 
than to add sextant data. The difference is basically that uncertainties 
produced from the ranging device only are correlated so that they 
propagate better. However, some recent studies have showii that the ranging- 
device alone may provide unstable solutions, giving good reeulto.at 
some points and not at others. This problem needs additional investigation. 

Uncertainties resulting from sextant measurements usually decrease 
upon propagation while those produced by the ranging device, with or 
without the sextant, increase. However, the use of the ranging device 
results in such small uncertainties that even upon propagation they are 
still less than those produced by the sextant alone. 

A W-matrix of 1 000 000 ft - 1000 fps was used to reinitialize 
the fit-world covariance. The optimal variance for processing range 
measurements is from 500 to 1000 ft when they are taken with sextant 
marks (ref. 2). When range measurements are taken alone they should 
be processed with a variance eq.ua! to the real noise. 

NAVIGATIONAL CAPABILITY OF SEXTANT 

It has been shown that if the relative state is determined 
solely by sextant data and ignoring a priori knowledge, the uncertainties 
are horrendous. The sextant may be used successfully, however; the 
sextant’s beneficial effects are derived by depending heavil;^ on a 
priori state knowledge and building correlations between the iii-plane 
orbital elements which cause the uncertainties to decrease u|)on propagation* 


The trajectories considered are the same as for the 15-n. mi. 

Ah case discussed previously. A W-matrix of 1000 ft - 1 fps was used to 
reinitialize the fit-world covariance before the first mark. 

The sextant has almost no capability to determine line-of -sight 
range over short arcs; it can, however, refine position uncertainty 
perpendicular to the line of sight. By using a small W-matrix, the 
position uncertainties along the line of sight are not allowed to grow 
and yet some refinement of position uncertainty perpendicular to the 
line of sight is achieved. 

To understand the reason the sextant can produce a reduction of 
uncertainties, one must look at the relative state covariance matrix. 

A brief description of the covariance matrix (modified to have correla- 
tion coefficients in the lower portion) and the coordinate system is 
found in. the appendix, which should be understood before proceeding with 
this discussion. 

The covariance matrix at the beginning of inter vehicular tracking 
is given in table III. This matrix represents the initial relative state 
uncertainties for all cases discussed in this note. 

Table IV gives relative state covariance matrices for the end of 
sextant tracking and TPI. 

At the end of tracking, there is a strong positive, correlation between 
X and y and_a strong negative correlation between x, y, and x. Looking at 
the uncertainties in the axes, this may be basically interpreted as 
saying that, if the chaser vehicle were actually 5 S 00 ft ahead of the 
nominal, then it would be 1300 ft above and have a radial velocity 
differing by -T fps. This correlation in position is along the line of 
sight, as woTJild be expected. 

During a coelliptic phase these correlations have a lasting 
property. The same strong correlations exist 10 minutes after the end 
of tracking. However, if a vehicle had a radial velocity differing by 
-T fps and was 1300 ft above the nominal, then within 3 minutes it would 
have the same radius as the nominal and yet still be 5800-ft down 
range. But this would contradict the strong correlation between x and y. 

That is, there would be no displacement in x and a large displacement 
in y. 

So, the correlations in the orbital elements combined with their 
lasting property upon propagation provide a contradiction. The correla- 
tions are in some sense opposed to each other. The result might be 
expected to be a compromise in which a vehicle above and ahead of the 
nominal (or by the same reasoning below and behind) would move slowly 


along the line of sight toward the nominal vehicle. The result would 
he a decrease in uncertainties upon propagation, aa is seen in table IV 
by comparing the ESS imcertainties at end of track and TPI. The 
uncertainties decrease about 2^ percent. 

If these kinds of beneficial correlations are produced when the 
chaser vehicle is below and behind (or above and ahead), what would 
happen if the chaser vehicle leads and is below the target? To answer 
this qtuestion, a case was run where the chaser vehicle was leading through 
the tracking period. The Ah was again 15 n, mi. The initial elevation 
angle of the target was arranged so that the elevation angle at the 15 th 
mark was equal to the elevation angle at the first mark in the previous 
case. The resulting covariance matrices are given in table V. 

At the end of track, x and x are positively correlated, and x 
and y are negatively correlated. By the same reasoning as in the pre- 
vious discussion, a vehicle ahead and below of its nominal position 
■vrould tend to move out along its line of sight, thus increasing uncer- 
tainties upon propagation. 

Indeed, comparison of end- of- track uncertainties and TPI uncer- 
tainties show this effect. The uncertainties increase about 20 percent. 

This result Indicates that the sextant should not be used alone 
if the chaser vehicle is either below and ahead or above and behind the 
targ* • « This conclusion applies only during coelliptic situations. 

FortV' ^itely, this tj/pe of tracking Is not planned for any mission. 


Ibe sextant is useful as a navigation instrument in two respects. 
First, it reduces out-of -plane uncertainties very effectively. This 
is especially important in lunar orbit. Secondly, if the chaser vehicle 
is below and behind or above and ahead of the target, sextant marks will 
produce correlations that will cause uncertainties to propagate downward. 

The beneficial correlations seem to last beyond the end of sextant 
tracking only when in a coelliptic situation. Reference 3 gives results 
of error analysis of a rendezvous sequence for AS-205/101. Despite 
35 sextant sightings taken between NCC and CDH, not a coelliptic 
sequence, no reduction of uncertainties was achieved. With only 15 marks 
between NSR and TPI, a 70 percent reduction was effected. 


ANOTHER BOOK AT SEXTANT EFFICIENCY AS A FUNCTION OP Ah 


As previously noted, uncertainties at TPI decreased with de- 
creasing Ah. Actually the uncertainties at the end of tracking differ 
only slightly, however. The difference is produced by propagational 
effects . 
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In table VI the covariance matrices after the 15 sextant marks 
have been incorporated (actually epoched to the beginning of the tracking 
arc) for Ah = 40 n. mi. and Ah = 10 n. mi. Note the absence of strong 
correlations in the former and the existence of strong correlations in 
the latter. By the previous analysis, this is the cause of the different 
propagation properties ♦ 

For the Ah = 4o n. mi. case, there is more difficulty building a 
strong correlation between x and y since the uncertainties perpendicular 
to the line of sight are more difficult to remove due to noise and bias 
on the angle measurements. That is, at a distance r, noise of angle 
0 will produce a linear displacement, r0, perpendicular to the line of 
sight. 

CONCLUSIONS 

(1) The sextant’s ability to reduce relative state uncertainties 
is based almost solely on establishing correlations between in-plane 
orbital elements which tend to reduce uncertainties upon propagation. 

Also the sextant reduces out-of-plane uncertainties extremely well, 

(2) The beneficial correlations produced by sextant sightings 
must have a lasting property to effectively reduce uncertainties., The 
correlations seem to endure after the last sextant mark only when a 
coelliptic phase is being considered. Under other conditions, the 
correlations disappear rapidly and the benefits derived from sextant 
tracking are doubtful. 

(3) The sextant’s ability to reduce relative state uncertainties 
increases slightly with decreasing Ah, during the coelliptic phase. At 
smaller Ah, the sextant is able to produce stronger correlations*., 

# 

(4) The ranging device and ranging device with sextant both 
have a definite navigation capability. That is, they produce a reduction 
of uncertainties by solving a dynamic problem and not just building 
beneficial correlations and depending on propagational effects. 


TABLE I - 3o POSITION AND VELOCITY UNCERTAINTIES BEFORE 
SEXTANT TRACKING AND AT TPI F\)R VARIOUS Ah 











TABLE II - RELATIVE POSITION AND VELOCITY TJNCERTAINTIES 
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TABIZ VI.- MDDIFIH) RELATIVE STATE COVARIAHCE MATRICES 
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?'vjle residuals, deg 



Pi^re 1 Azimuth angle residuals as a function of Ah. 




17 


preceding 


page blank not filmed. 


APPEHDIX A 

DBPIWmoW OP LOCAL COOEDmAlPB SYSEEM AMD 
MODIFIED EELAEIVE SEAEE COVARIANCE MAERK 


^^|CFn/NG 


Rl.AMfc 


^OT filmed 


APPENDIX A- DEFINITION OF LOCAL COORDINATE SYSTEM 
AND MODIFIED RELATIVE STATE COVARIANCE MATRIX 

LOCAL COORIDNATE SYSTE^I 


Tlie local coordinate system used in this report is defined as 
follows: z is measured in the direction of the angular momentum 

vector, X is measured radially, and y completes the right-hand system. 

MODIFIED RELATIVE STATE COVARIANCE MATRIX IN LOCAL COORDINATE SYSTEM 

The form of the modified relative state covariance matrices 
presented in this report is given below. 
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Correlation coefficients, 
matrix and are given by 


uncertainty in x 
uncertainty in y 

uncertainty in z 

• 

uncertainty in x 
uncertainty in y 
uncertainty in z 

p^j, appear in the lower left half of the 


P 
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Talkie A-I is a typical relative state covariance matrix measured 
in the local coordinate system of the chaser vehicle. Actually, 
in practice the covariance matrices differ little from one vehicle’s 
system to another since they are so close during rendezvous. 

Correlation coefficients appear in the lower left half of the matrix. 
Correlations are called ’’strong” or ’’significant” if they exceed 0.9 in 
absolute value. We notice in this example that there is a strong posi- 
tive correlation between x and y end a strong negative correlation 

between x and x. By reading the square roots of the diagonal elements 
we get the uncertainties in each component, but the correlations give 
more information. For this covariance we know that if a vehicle is 
ahead of the nominal (positive y) then it is higher (positive x) and 

has a greater velocity downward tnegative x). Another covariance with 
the same diagonal terms may represent a much different type of uncer- 
tainty because of different correlations. 
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